Enablingmarkovian representations under imperfect information

Markovian systems are widely used in reinforcement learning (RL), when the successful completion of a task depends exclusively on the last interaction between an autonomous agent and its environment. Unfortunately, real-world instructions are typically complex and often better described as non-Markovian. In this paper we present an extension method that allows solving partially-observable non-Markovian reward decision processes (PONMRDPs) by solving equivalent Markovian models. This potentially facilitates Markovian-based state-of-the-art techniques, including RL, to find optimal behaviours for problems best described as PONMRDP. We provide formal optimality guarantees of our extension methods together with a counterexample illustrating that naive extensions from existing techniques in fully-observable environments cannot provide such guarantees

Protocol for the saMS trial (supportive adjustment for multiple sclerosis): a randomized controlled trial comparing cognitive behavioral therapy to supportive listening for adjustment to multiple sclerosis

BackgroundMultiple Sclerosis (MS) is an incurable, chronic, potentially progressive and unpredictable disease of the central nervous system. The disease produces a range of unpleasant and debilitating symptoms, which can have a profound impact including disrupting activities of daily living, employment, income, relationships, social and leisure activities, and life goals. Adjusting to the illness is therefore particularly challenging. This trial tests the effectiveness of a cognitive behavioural intervention compared to supportive listening to assist adjustment in the early stages of MS.MethodsThis is a two arm randomized multi-centre parallel group controlled trial. 122 consenting participants who meet eligibility criteria will be randomly allocated to receive either Cognitive Behavioral Therapy or Supportive Listening. Eight one hour sessions of therapy (delivered over a period of 10 weeks) will be delivered by general nurses trained in both treatments. Self-report questionnaire data will be collected at baseline (0 weeks), mid-therapy (week 5 of therapy), post-therapy (15 weeks) and at six months (26 weeks) and twelve months (52 weeks) follow-up. Primary outcomes are distress and MS-related social and role impairment at twelve month follow-up. Analysis will also consider predictors and mechanisms of change during therapy. In-depth interviews to examine participants’ experiences of the interventions will be conducted with a purposively sampled sub-set of the trial participants. An economic analysis will also take place. DiscussionThis trial is distinctive in its aims in that it aids adjustment to MS in a broad sense. It is not a treatment specifically for depression. Use of nurses as therapists makes the interventions potentially viable in terms of being rolled out in the NHS. The trial benefits from incorporating patient input in the development and evaluation stages. The trial will provide important information about the efficacy, cost-effectiveness and acceptability of the interventions as well as mechanisms of psychosocial adjustment.Trial registrationCurrent Controlled Trials ISRCTN91377356<br/

Circulating Cell-Free DNA in Dogs with Mammary Tumors: Short and Long Fragments and Integrity Index

Circulating cell-free DNA (cfDNA) has been considered an interesting diagnostic/prognostic plasma biomarker in tumor-bearing subjects. In cancer patients, cfDNA can hypothetically derive from tumor necrosis/apoptosis, lysed circulating cells, and some yet unrevealed mechanisms of active release. This study aimed to preliminarily analyze cfDNA in dogs with canine mammary tumors (CMTs). Forty-four neoplastic, 17 non-neoplastic disease-bearing, and 15 healthy dogs were recruited. Necrosis and apoptosis were also assessed as potential source of cfDNA on 78 CMTs diagnosed from the 44 dogs. The cfDNA fragments and integrity index significantly differentiated neoplastic versus non-neoplastic dogs (P<0.05), and allowed the distinction between benign and malignant lesions (P<0.05). Even if without statistical significance, the amount of cfDNA was also affected by tumor necrosis and correlated with tumor size and apoptotic markers expression. A significant (P<0.01) increase of Bcl-2 in malignant tumors was observed, and in metastatic CMTs the evasion of apoptosis was also suggested. This study, therefore, provides evidence that cfDNA could be a diagnostic marker in dogs carrying mammary nodules suggesting that its potential application in early diagnostic procedures should be further investigated

Quality of life in childhood epilepsy with lateralized epileptogenic foci

<p>Abstract</p> <p>Background</p> <p>Measuring quality of life (QOL) helps to delineate mechanisms underlying the interaction of disease and psychosocial factors. In adults, epileptic foci in the left temporal lobe led to lower QOL and higher depression and anxiety as compared to the right-sided foci. No study addressed the development of QOL disturbances depending on the lateralization of epileptogenic focus. The objective of our study was to examine QOL in children with lateralized epileptiform discharges.</p> <p>Methods</p> <p>Thirty-one parents of children with epilepsy filled the Health-Related Quality of Life in Childhood Epilepsy Questionnaire (QOLCE). Fifteen children had foci in the left hemisphere and sixteen in the right, as verified with Electroencephalography (EEG) examinations.</p> <p>Results</p> <p>We found a significant correlation between foci lateralization and reduced QOL (Spearman's rho = 0.361, p < 0.046). Children with right hemispheric foci exhibited lower overall QOL, particularly in five areas: anxiety, social-activities, stigma, general-health, and quality-of-life.</p> <p>Conclusions</p> <p>We demonstrated for the first time that in children left- and right-hemispheric foci were associated with discordant QOL scores. Unlike in adults, foci in the right hemisphere led to worse emotional and social functioning demonstrating that seizures impact the brain differentially during development.</p

Exploring the Feasibility of Service Integration in a Low-Income Setting: A Mixed Methods Investigation into Different Models of Reproductive Health and HIV Care in Swaziland.

Integrating reproductive health (RH) with HIV care is a policy priority in high HIV prevalence settings, despite doubts surrounding its feasibility and varying evidence of effects on health outcomes. The process and outcomes of integrated RH-HIV care were investigated in Swaziland, through a comparative case study of four service models, ranging from fully integrated to fully stand-alone HIV services, selected purposively within one town. A client exit survey (n=602) measured integrated care received and unmet family planning (FP) needs. Descriptive statistics were used to assess the degree of integration per clinic and client demand for services. Logistic regression modelling was used to test the hypothesis that clients at more integrated sites had lower unmet FP needs than clients in a stand-alone site. Qualitative methods included in-depth interviews with clients and providers to explore contextual factors influencing the feasibility of integrated RH-HIV care delivery; data were analysed thematically, combining deductive and inductive approaches. Results demonstrated that clinic models were not as integrated in practice as had been claimed. Fragmentation of HIV care was common. Services accessed per provider were no higher at the more integrated clinics compared to stand-alone models (p>0.05), despite reported demand. While women at more integrated sites received more FP and pregnancy counselling than stand-alone models, they received condoms (a method of choice) less often, and there was no statistical evidence of difference in unmet FP needs by model of care. Multiple contextual factors influenced integration practices, including provider de-skilling within sub-specialist roles; norms of task-oriented routinised HIV care; perceptions of heavy client loads; imbalanced client-provider interactions hindering articulation of RH needs; and provider motivation challenges. Thus, despite institutional support, factors related to the social context of care inhibited provision of fully integrated RH-HIV services in these clinics. Programmes should move beyond simplistic training and equipment provision if integrated care interventions are to be sustained

The effect of timing and frequency of push notifications on usage of a smartphone-based stress management intervention: An exploratory trial

Push notifications offer a promising strategy for enhancing engagement with smartphone-based health interventions. Intelligent sensor-driven machine learning models may improve the timeliness of notifications by adapting delivery to a user's current context (e.g. location). This exploratory mixed-methods study examined the potential impact of timing and frequency on notification response and usage of Healthy Mind, a smartphone-based stress management intervention. 77 participants were randomised to use one of three versions of Healthy Mind that provided: intelligent notifications; daily notifications within pre-defined time frames; or occasional notifications within pre-defined time frames. Notification response and Healthy Mind usage were automatically recorded. Telephone interviews explored participants' experiences of using Healthy Mind. Participants in the intelligent and daily conditions viewed (d = .47, .44 respectively) and actioned (d = .50, .43 respectively) more notifications compared to the occasional group. Notification group had no meaningful effects on percentage of notifications viewed or usage of Healthy Mind. No meaningful differences were indicated between the intelligent and non-intelligent groups. Our findings suggest that frequent notifications may encourage greater exposure to intervention content without deterring engagement, but adaptive tailoring of notification timing does not always enhance their use. Hypotheses generated from this study require testing in future work. Trial registration number: ISRCTN67177737 © 2017 Morrison et al

Subtropical grass pollen allergens are important for allergic respiratory diseases in subtropical regions

Background: Grass pollen allergens are a major cause of allergic respiratory disease but traditionally prescribing practice for grass pollen allergen-specific immunotherapy has favoured pollen extracts of temperate grasses. Here we aim to compare allergy to subtropical and temperate grass pollens in patients with allergic rhinitis from a subtropical region of Australia. Methods. Sensitization to pollen extracts of the subtropical Bahia grass (Paspalum notatum), Johnson grass (Sorghum halepense) and Bermuda grass (Cynodon dactylon) as well as the temperate Ryegrass (Lolium perenne) were measured by skin prick in 233 subjects from Brisbane. Grass pollen-specific IgE reactivity was tested by ELISA and cross-inhibition ELISA. Results: Patients with grass pollen allergy from a subtropical region showed higher skin prick diameters with subtropical Bahia grass and Bermuda grass pollens than with Johnson grass and Ryegrass pollens. IgE reactivity was higher with pollen of Bahia grass than Bermuda grass, Johnson grass and Ryegrass. Patients showed asymmetric cross-inhibition of IgE reactivity with subtropical grass pollens that was not blocked by temperate grass pollen allergens indicating the presence of species-specific IgE binding sites of subtropical grass pollen allergens that are not represented in temperate grass pollens. Conclusions: Subtropical grass pollens are more important allergen sources than temperate grass pollens for patients from a subtropical region. Targeting allergen-specific immunotherapy to subtropical grass pollen allergens in patients with allergic rhinitis in subtropical regions could improve treatment efficacy thereby reducing the burden of allergic rhinitis and asthma